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Abstract . * • 

CEQ-The Advisor ratings froa AOO of 763 class sections £rom the spring oi 

1971 adalnlstratl'on were divided into two groupfs of 200 sections each. The 

eecttons war* separated into five groups depending on jthe proportion o£ atu** 

d^ts taking tbe class as a requlresient* These proportions were as follows i 

more than 4/5 of the/ student enrollment was mandatory, 3/5 to 4/5 of^student 

entollnent was laandatory, etc, / 

Identical analyses were performed on each sample with identlcill results. 

One-way. analyses of Variance (ANOVA) on each of the six subscales of the CEQ 

yleldki statistically significant differences among the mean ratings of the 

five gro.ups« Polynomial trend analyses subsequently showed that the linear^ 

trend was significant (p < *01) In each case. This rafduft irijplied that as the 

proportion of students taking a class because of a requirement Increases^ 'the 

rating^ given to the coprae and Instructor decreases « , \^ 

Suggestions were made to caution Instshiictors about Interpreting CEQ res^ 

ults for classes which have high or low pv'oportlons of requirement enrolled 

I 

students^ It was suggested also that further investigations be performed In 
this ^rea before the results presented here are regarded ^s conclusive evidence. 
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• W0UL6 THE PKOPORTION bP STUDENTS TAKING A 
CLASS AS A REQUIREMENT AFFECT STUDENT RATING OF THE COURSE? 
Gerald M. Gillmote and Dale C. Brandenburg 

The perennial problem of determining the effectiveness of the college 
instructor has been pondered over » particularly by those dirVctly involved 

in the educational system. To h^e college instructors rated by their stu- 

• ■■ ■ - _ ' . ' 

dento Is not a universally accepted procedure among college staffs, instead 
it presents an area of cpntroversy. Sources of objections to such \ pro- 
cedure are manif old| Especially from the faculty members who ate probably p 
worried about their possible rating and from administrators who are concerned 
about faculty morale. Ryans (1954) .discussed this attitude of college 
Instructors toward student ratings and listed reasons why Instructors are 
generally opposed to having their students rate them. ^ ^ ^ 

At the University of Illinois, Urbana-'Champaign, one instrument us6d to 
evaluate teaching effectiveness was the Illinois Course Evaluation Question*- 
naire-The Advisor (C^Q-The Advisor). Irt 1962 a committee from the Student 
Senate agreed to investigate the quality of teaching on| the campus (Dillman^ 
1970). From 1962 until 1968, several polls of student opinion of teacher 
effectiveness were taken at the University. However, a complete overvlcfw 
of student opinion could not be obtained for a number of reasons. Finally, 
in 1968, the Subconanittee on Course and Teacher Evaluation of the Educational 
Affairs Coimnlttee of the Student Senate, with the cooperation of the deans 
and heads of departments of the colleges, decided to obtain an evaluation 
of teachers and courses by distributing questionnaires in the classroom. 
Starting in the school year of 1968, students rated their instructors and 
courses by answering objectiva questions on = computerized forms at the end 



-'J 

2. 



of each semester. On the back oC the quest lonnMre fora they also responded^ * 
to open-ended questions » such as: What are your general comments about the 



Instructor in this course? For thorough details about the development of 
The Advisor see Feldman^s report (1970). 

The questionnalte used for evaluating the courses offered ip the spring 
seqester of 1972rwas called the CBQ-The Advisor, The CEQ instrument consists 
of 50 it^s which are divided into six subscliles: General Course Attitude, V 
Method of iMtruction, Course Content, Interest ^ Attention^ Instructor, and 
Specific Items (Alsamoni and Spencer, 1973) . The first through the fifth 
subscales contain eight items each; the last subscale has ten items (see 
Appendix A) • This ^.nformation is shown in Table 1. 

' ; Tdble 1 

Subscales of the CEQ-The Advisor 



Subscales 



1. General Course Attitude 

2. Menhod of Instruction 

3. Course Contei^t, 

4. Interest - Attention 



5, ' Instructor 



6* Specific Item$ \ 



Total 



Number of Items 



8 
8 

8 
8 
8 

10 



■50 



0 
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Students Indicate their degree agreement or disagreement on each 
item. Responses to the 50 questionnaire^ items are based on a four-point 
scale of Strongly Agree (SA), Agree (A), Disagree (D), and Strongly Disagree 
(SD). These alternatives receive the wetp';t of 4, 3, 2, and 1, respectively/ 



for the positively stated Items and the reverse weighting for the negative ones 
ISach Item has a predetetmlned best answer which receives the highest woightl» 
The mean of each item Is calculated by the arithmetic average of the*students* 
responses.. Higher means on the CE(}^The Advisor indicate more favorable atti«- 
tudeot ' 

the CEQ-The Advlsofr Is voluntatJ^ly administered by the Instructbr to his 
class. After the answer Sheets are scored the results are returned to the 
instructor who administered the' instrument . the purposes of the CEQ^The 
Advisor are to provide the instructor with some insight into the manner In 
which he and hie course are perceived by hin students and thus suggest ways 
to Improve his course; to make publication of results available to the 8tu«* 
dentsj to give. the students aii opportunity to gain broader knowledge of course 
^ material t methods » and objectives than is now available; and to enable the 
administrators within each college to gain Insight into the ovi^rall effect* 
ivetiess of its course offerings. ' ^ 

The purpose of this study was ^o determine whether student overall 
ratings of courses are affected by the proportion of the class taking it as a 
requirement. In other words, does the class with the majority, say 80X, of 
students taking it as a requirement receive lower ratings than a class with 
a smaller percentage of students taking it m a requirement? Other investl- ^ 
gations (Gage, 1961; Heilman and Armentrout, 1936; Lovell and Haner, 1955) 
have shoyn conflicting results. The null hypothesis to be tested was that . 
there is no significant difference among the ratings obtained when differing 
proportions of students take a course as a requirement. 



Method 

Subjeote 

The data waa obtained from Instructors vho voluntarily administered the 
CEQ«*The Advisor to their classes in the spring semester of 1971 » Both under-* 
graduate an^l graduate level classes were used« The instrument was administered 
during regular class or final examination periods* In all classes, the ques« 
tionnaire was given near enough to the end of the semester uo that students * 
could estimate their current p'erformance in the course. A total of 763 class 
sections W;6|e availoble for study » 

Variable/ • ? / , 

This study used the six CEQ subscales as dependent variables « These aroi 
(1) General Course Attitude, (2) Method of Instruction, (3) Course Content, 
(4) Interest -- Attention, (5) Instructor, and (6) Specific Items« The indepen^ 
dent variable, proportion of students taking a course as a requirement, was 
formed by dividing available class results into five groups as follows: 

Group, 1 was composed of the classes which^had 80% of the students taking 
the course as a requirement » ^ 
Group 2 was composed of the classes which had 60% to 79% of the students 
taking the course ^ requirement » 

Groups 3, 4, and 5 simllarily consisted of 40% to 59%, 20% to 39%, and 

■ ' ' ' \ 

- , ■ ■ ' . ■ ■" 

less a:Kan 20% of the students taking the course as a requirement, respec- 
tively. 

Data Analysis x 

' ■ ■- r 
In this study the total sample of 763 sections was randomly divided into ^ 

^ , ■ " - ■ ■■" / 

two samples of 200 sections each\ The only restriction of selecting the data j 

was that the same course taught by the same instructor was not Included in the 

i 

same group. The differences in, ratings were examined within each subscale. 



Means for each subscale of each group were computed. One-way ANOVA was used 
for Investigating the difference in ratings within each sub^^le. The over-^ 
all strength of association between the percentage of students taking courses 

a requirement knd the rating was estimated by the following formula (Hays> . 
1963, p. 38i).. 

est fii* t. be tveen - («/ > 1) Afg within 
SS total + MS within 

* * . « - ' 

where d ^ number of groups 



The polynomial regression technique was then appl^Led in order to Investi-* 

\ ' • • . • 

^gate the trend of the relationship between dependent and Ividependent variables 
within eachsample/ ^ 

, , Results , 

General Couree Attitude • ' . 

The means obtained from th<B ratings for the five groups In both samples 

' ate shown in Table 2. For Sample 1> the highest mean was 3<32 and the lowest 
was 2*94; for Sample 2, the highest mean was 3.37 and the lowest waa 2.93. 
The classes which had less than 20% of the students taking the course as a 
requirement received the highest rating* while the lowest rating was observed 
for the group which had m:>re than 86% required^^enrollment students. The res- 
ults in both samples we^e similar. 



It should be noted that the polynomial regression technique was applied 
in this case even 'though there may have been a violation of one of its 
assumptions. That is, the abscissa had five points which do not neces-^ 
sarily constitute an interval scale. However, we ar^ confident that the 
measure jn the abscissa (proportion of class) is at least monotonically 
related to the true proportion scale based on group means* Therefore, 
rar analyses for trend are approximate and the seriousness of the viola^ 
tion crnnot be regarded as a detriment to the results in general (Nuhnelly^ 
1967, p. 25); 
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Table 2 

Means for General Course Attitude 



Group 



N 



Sample 1 


Sample 2 


Sample 1 


Sample 2 


56 


80 


2.94. 


2.93 


27 


35 


3.11 • 


3.04 


27 


26 


3.04 


3.21 


A8 


22 


3.24 


3.25 


42 


37 1 


3.32 


3.. 37 



1. 80-100%. required 

2. 60-79% required, 

3. 40-59% required . 

4. 20-39% required 

* ' ■ • ■ ' 

5. Leas th^rv^O^ required 



One-way ANOVA was perf oraed using the proportion of required-e)irollment 
students^' asv the independent var lab) e and the obtained subscale ratings as the 
dependent variable. The F-ratio was statistically significant with probabillt 
of less than jOl in both sjamples (see Table 3 for ANOVA) . The Index of (O^ 
showed thai: the in^ji^pfendent variable was estimated to account for only 12% of 
the variance in the ratings for Sample 1» and 20% for Sample 2. Thus, knowing 
a student • 8 group tnembershi^^oes not apfpreciably assist in predicting his 
rating ol the class • In both saitplea, the trend of the relationship between 
the Independent and dependent variables was linear. In other words» the linear 
regression was fitted to the data, and It was found to be statistically signi- 
ficant at the .01 level. This result is shown in Table 3 and graphed in 
Figure 1. ^ * * 



Table 3 

One-way ^OVA Iticludi ng^^th e Tost for Linear 
Trend and Estin^tpd for General Course Attitude 



Source of Variation 




ss 


m 


P 




Sample 1 


Between Groups 


4 


4.4922 


1.1231 


V.8858* 


0.1210 


Linear Trend 


1 


4.0974 


4.0974 


28.7739* 




' R^sl'dual 


3 


0. 3948 


0.1316 






Within Groups 


195 


27.7709, 


0.1424 






Total 


19^ 


32.2631 








Satople 2 


Between Groups 


4 


5.9354 


1.4838 


13.4182* 


0.1990 


Linear Trend 


1 


5.8580 


5.8580 


52.9656* 




Residual ' 


3 


0.0774 


0.0258 






Wlthifi Groups 


195 


21.5639 


0.1106 






Total 


199 


27.4993 









*p < .01 . ^ . ^ 



Method of InetriKytion ^ . i 

The means for the Method of Instruction subecale are given In Table 4« In. 
both samples, the highest ratings were In the fifth group, l.e», less than 20% 
of requlredr-enrollment studentSi while the[ classes which had more than Q0% of 
required-enrollment students received the lowest ratings. • 



\ \ FIGURE I 

LINEAR RELATIONSHIPS OF MEAN RATINGS 
FOR GENERAL COURSE ATTITUDE 
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Table A 

Means for Method of Instruction 





N ■ i 




Group 


Sample 1 


Sample 2 


Sample 1 


Sample 2 


1 


56 


80 


2.69 


2.72 


2 


27 


35 


: 2.87 


2.86 


3 


27 


26 


2.7it 


2.90 


A 


A8 


22 


2.95 


2.86 


.' 5- ■ ' 


A2 


37 


2.98 > 


3.08 


Total 


200 


200 


2.85 


2.85 



The results of one-way ANOVA are shown in Table 5* The tests yielded 
significant P-ratlos with probability less than .01 in both samples. However > 
the proportion of required-enrolltnent students In class was estimated (via w^) 
to account for about 6% of the variance for Sample 1 ratings and slightly 
over S% for Sample 2. The trend analysis ahovjed that linear regression was ^ 
fitted to the data in both cases and the result was statistically significant 
' "at *01 level as shown in Table 4. An illustration of the lihe« tr^^ 
mean ratings is given in Figure 2. 

Course Content. ' - 

The first group of students gave the lowest mean ratings for the Course 
Content subscale, specifically, 2,78 and 2.70 for Sample 1 and Sample 2, 
respectively. The classes which were composed of luss than 20% of required- 
enrollment stude;it3 received the highest ratings as shown in Table 6\ these 
wercf 3.04 for Sample 1 and 3.08 for Sample 2. In Sample 2, the class rating 
means increased as the proportion of the required-enrollment students decreased^ 
A similar result can be noted in Sample 1 except for a reversal between Groups 
ERLC 2' and 3. 



Table 5' 

One-way AKOVA Including the Teat for Linear 
Trend and EstloatiBd to* for Method of Instruction 

% . '* * ' " 



Source of Variation 


df 


55 


MS . 




0)^ 




J Sample 


1 






— — 


Between Groups 


4. 


2:7600 




0.6900 


4.0'584* 


0.0576 


Linear Trend / 


1 


2.3515 




2.3515 






A^ldual 


3 


0.4085 




0.1362 






Within Groups 


195 


33.1527 




0.1700 






Total 


199 


35.-9127 














Sample 


2 








Between Groups 




3.5442 




0.8860 


5.6248* 


•,0.0847 


Linear Trend 


I 


3.137? 




3.1377 


19.9219* 




Residual 


3 


0.4065 




0.1355 






Within Groups 


195 


30.7175 




0.1575 






Total 


199 


34.2617 











*p < .01 



Table 6 
Means for Course Content 



Group 



N 




Sample 1 


Sample 2 


Sample 1 


Sample 2 


1 


56 


80 


2.78 


2.70 


2 


27 


35 


2.88 


2.82 


3 


27 


26 


2.86 


2.95 


4 


48 


22 


3.00 


' 3.03 




42 


37 


3.04 


3.08 


Tothl 


200 


200 


2.91 


2.86 



FIGURE 2 

LINEAR RELATIONSHIPS OF MEAN RATINGS 
FOR METHOD OF INSTRUCTION 
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The f-falio from one-way ANOVA was significant at .01 level in. both aanples. 
The eatimated for Samples 1 and 2 were .11 and .24, respectJvely. The linear 
trend was statistically significant at IX level, ^^the results of the above enal- 
yee* are i>re8ented In Table 7 . Figure 3 shows the linear trenj for the oean 
ratings of each group in ea6h sample. 

; . \' Table 7 

One-way ANOVA Including the Test for Linear 
Trend and Estimated (o^ for Courde Content * 



Source"^ of Variation ' 


df 


SS ' 


MS 


F 




• • 




Sample 1 








. Between Groups 


it 


2.0965 




0.52A1 


6.9197* 


0.1063 


Linear Trend * 


1 \ 


1.9577 




1.9577 


25.8613* 




Residual 


3 


0.1388 




0.0A63 






Within Groups 


195 


1A.7701 




0.0757 






Total 


199 


16.8666 












Sample 


Between Groups 


A 


A. 5993 




0.1150 


16.6740* 


0.2387 


Linear Trend 


1 


A.A93? 




4.4932 


65.1168* 




Residual 


3 




0.1051 




0.0350 






Within Groups 


195 




13.4A69 




0.0690 






Total 


199 




18,0A62 











*p < .01 



FIGURE 3 

LINEAR RELATIONSHIPS OF MEAN 
RATINGS FOR COURSE CONTENT 
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Jn^r^at - Attention 

Ab observed in the previous analyses » the group which had lees than 20X of 
the requitedi^enrollment students In class gave the l^hest ratings for this sub* 
scale in both samples* The lowest ratings for the Interest ;r Attention subscale 
were in the first group and these were 2 « 61 and 2«62 for Samples 1 and 2| respect 

ively. The iseans for this ^ubscale are shown in Table 8^ 

■ ■ *^ 

'*""'■■ I ' 

' Table " \ 

Means for Interest - Attention 



Group 




5 




Sample 1 


Sample 2- 


Sample 1 


Sample 2 


1 


56 


80 


2.61 


2.62,, 


. 2 


27 




2.82 


2.75 


'. 3. . 


27 


26 


' 2.75 


2.94 




A8 


22 


2.99 


2.99 


5 


^2 


37 


3,02 


3.11 


Total 


200 


200 


2,84 


2.82 



According to the one-way AlIOVA results > the hypotheslts of, no effect of the 
proportion of the required-enrollment students In clajsa on the ratings was . 
rejected at .01 level in both sauiples. Approximately 12% and 19X of the vari- 
ance in ratings (estimated by w*) was accounted for by the proportion of the 
requir^d-^enroUment students in Samples 1 and 2, respectively. The result of 
the trend analysis was significant at .01 level for a linear trend. Therefore, 
the llhear regression was fitted to both data sets. The results of these 
analyses are $lv<*n In Table 9. Figure 4 illustrated the linear trend for the 
oe^n tat ings of this variable for each group in each sample. 
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Table 9 

One-way ANOVA Including the Tost for Lineaif 
Trend and Estimated for Interest - Attention 



Souvce of Variation 


df 


ss 


MS 


F 




. 

— 




Sample 1 






Between Groups 


t 

H 


5.5610 


1.3903 


s 1 

7 •9181* 


Oil215 


Linear Trend 


1 


4.9641 


4.9641 


28.2694* 




Residual 


3 


0.5969 


0.1990 , 






Within Groups 


.195 


34.2381 / 


0.1756 






Total 


199 


39.7991 

— ■/ . 








• 




a Sample 1 


Z 






Between Groups 


. 4 


7.52^8 


1.8825 


12.9811* 


0.1933 


Linear Trend 


I 


7.3914 \ 


♦7.3914 


50.9752* 




Residual 


3 


0.1384 


\ 0.0461 






Within Croups 


a95 


28.2780 


\ 0.1450 






total 

-* 


^199 


35/8079 









*p < .01 , 

' ' ' ■ ■ / 



Instructor 

The means of instructor rating are presented in Table 10. The instlructors 
teaching^ classes which had more ttean 80% of the required-enrollment students 
(Group 1) received the lowest rating^ i.e.» 3.06 and 3.03 in Samples 1 and 2, 
respectively. The instructors teaching the fourth group> i.o»i 20% -39% of 
the required-^enrollment students^ received the highest ratings in Sample 1 and 
the ones teaching ^lese than 20% of the roqulred-enrollment students received 
the highest ratings in Sample 2.. 



FIGURE 4 J 

LINEAR flELATIONSHIPS bF MEAN 
RATINGS FOR INTERESt-ATTENTION 
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Table 10 , ' ' * 

Means for Inattuctor 



Group 


N 






Santole 1 


Saop^e 2 




SamolG 2 


I 


56 


80 


3.06 


3.03 


2 


27 


35 


3.14 


3.12 


3 


27 


26 


3.12 


3.14 


4" 


48 


22 


3.24 


3.17 

t 


5 


A2 


37 


3.2? 


3.27 


Total 


200 


200 . 


3.16 


^3.12- 

» 



The results of one-way ANOVA are given in Table 11. ^The F-^ratlo was slgni<* 
ficant at .05 level for Sample 1^ and at «01 for Sample 2« The proportion of 
the required-enrolltnent students in class wqs ^estimated by (o^ to account for only 
about 3X and 6% of the variance in the instructor ratings In Samples 1 arid 2 » 
respectively. Only the linear regression was significant at .01 level In both 
sets» The results are given in Table 11* Figure 5 shows the linear trend for 
the mean ratings of the instructor subscale. , 
Speoifio It^ , • ^ 

For the. Specific Items subscale, the highest ratings were in the fifth 
groups i,«6ir 2.98 and 3.02 in Samples 1 and 2, respectively. Again, the first 
group gave the lowest ratipgs, I.e., >2«dS and 2.81 in Samples 1 and 2, respect** 
Ively. The mean ratings Increased as the proportion of the required-enrollinent 
students decreased in Sample ^ and a similar result was noted for ^iopl^^ 
except for a revers$l for Groups 2 and 3* The results are shown In Table J.2. 



Table 11 

> 

One-way ANOVA Including the Test for Linear 
Trend &nd Estimated (o^ for Instructor 



Source of Vc^riation 


' df 


55 




F 


(0* 


Sample l' 


Between Groupa 


4 


1.0120 


0.2530 i 


2.4472* 


0.0281 


Linear Trend 


1 


• 0.8341 


0.8341 


8.0667** 




Residual 


3 


0;i779 


0-.0593 




t 


Within Groups 


195 


20.1585 


0.1034 






^ Total 


199 


. 21.1705 









SamplS 2 



Between Groups 
Linear Trend 
Residual 
Within Groups 
Total 



4 


1.5433 


0.3858 


1 


1.4916 


1.4916 


3 


0.0517 


0.0172 


195 


17.6803; 


O.09O7 


199 


19.2236 





4.2554** 
16.4454** 



0.0611 



T 



*p < .05 
**p < ;01 



Table 12 
Means for Specific Items 



Group 




7 




Samole 1 


Samole 2 


Sample 1 


Sample 2 


1 


56 - 


80 


2.85 


2.81 


2 


27 


35 


2.92 


2:89 


3 


27 


26 


2.87 . 


2.97 




48 


22 


2.96 


2.98 






37 


2.98 


3.02 


tojtal 


200 . 


200 


2.92 . 


2.90 



FIGURE 5 ' 

LINEAR RELATIONSHIP^ OF MEAN 
RATINGS FOR INSTRUCTOR 
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Significant differences in ratings were lound at the #05 ^level in Sample 1 
and at the .01 level in Sample 2. Approximately 3% and slightly over 9% of the 
variances (estimated by w^) in ratings were accounted for by the percentage of 
required-enrollment students in >S^plee 1 and 2, respectively. In both data 
sets, the trend analysis was not significant beyond linear. The resultant 
analyses ^re presented in Table 13. Figure 6 shows the linear trend tot iMe 
mean ratings for each group within each sample. 

Table 13 

One-way ANOVA Including the Test for Linear ' 
T;rend and Estimated (o^ for Specific Items 



Source of Variation 


• df 


SS , 


MS - 


F 




Sample 1 ^ • 


Between Groups 


4 


0.6215 


0.1554 


2.5731* 


0.0305 


Linear Trend 




0.5195 


0.5195 


8.6010** 




Residual 


3 


0.1620 


0.0346 






Within Groups 




11.7747 


0.0604 






Total 


199 


12.3962 












Sample 1 


2 . 






Between Groups 


. . 4 . 


1.4096 


0.3524 


6.1956** 


0.0941 


Linear Trend 


1- 


1.3268 


1.3268 


23.3181** 




Residual 


3 


0.0828 


0.0276* 






Within Groups 


195 


11.0914 


0.0569 






Total 


199 


12.5610 






A 



*P < .05 
**p < .01 



FIGURE 6 

LINEAR RELATIONSHIPS OF MEAN 
RATINGS FOR SPECIFIC ITEMS 
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blscussioa and Conclusions 

The results of the atudy clearly indicate that ' instrucgtors and courses get» 
different ratings using the CRQ-The Advisor, depending upon the proportion of 
Students enrolled in a class who take that class as a requirement. In general/ 
it was found that the larger the proportion of students taking a, course as a / 
requirement, the lower the ratings given to, the cowse. 

This conclusion is justified for the following two reasons: 

(1) The overall f-ratio for each of the six CEQ-The Advisor, subscales for 
each of the two samples of class sections were statistically signifi- 
cant . V V 

(2) The results of the trend analyses for ea^h subscalc and satDple indicate 

a statistically significant linear trefid* In each case it was determined 
that the linear regression line fitted ^t^he data substantially beTter than 

any higher-order regression line (p < ,01 for linear; others not slgnlfl«- 

' - " ■ . ■ . , ■ ^ . • * ' '* 

cant) • V ' • — 

Thus, it is concluded that the linear standardized regression weight is different 

from zero (here, positive) for each analyslsv^]* ^ 

It can be observed from the tables of* m^ans for each subscale- that there does 

not appear to be substantial differenced between ttiie highest and lowest means for 

either of the two samples. However, if these means are Interpreted In reference 

to the norms for any bf the subscales, obvious and important decile differences 

can be noted* To illustrate this point Table 14 was developed in reference to 

the subscale norms from the CEQ Manual (Aleamoni, 1972) for total University x>f 

« ■ ■' ■ ' ■ . ■ ' ' > ■ 

tlllnois secftlons and the emallep o£ the two sample mean differences between 

Cro\ip 1 and Group 5i , . 



23. 



• Tabl6 14 \ 

Norm Decile Changes Corteapondlng to Group 1 
and Group 5 Mean Differences 



Subacale 


Means and Difference 


» Decile 


Change 


Group 1 


Group 5 


Diff . 


. Group 1 


.Group 5 


General Courae Attitude 


2.94 


3.32 


.38 


3 


\r 


•Method of Instruction 

V 


2.69 


2. 98 


.29 • 


4\ 


6, 


Courae Content 


2.78 


3.04 


.26 




' 7 ' 


Interest - Attention 


2^61 


3.02 


.41 




7 • 


Instructor . 


3.06 


3.22 


.16 " 






Specific Items 


2.85 


2.98 


.13 


4 


7 ' . 



It la easy to see ftom Table 14 that Group 1 ratlnga are below the median 
and Group 5 ri^tihga are atC or above, the median for each dubscaie\ 

This reault haa clear implicatlona toward the Interpretation of CEQ rat-^ 
Ingafor classes which have high or low proportions of required-enrollment 
students in a class. However, wo cannot confidently conclude that required 
courses' will always receive low ratlnga simply because those courses are "dull" 
from the atudent's pclnt of view. These results, on the other land, do show . 
in general that instructoirs in these courses ariS penalized because of the 
courae^a atatus. 

Other variables that may influence these ratings sihouid be lnvestlgate<^ 
before separate norm tables or another similar method la used .to equalize th^)^ 

to replicate this $tu 

with data from oth^r semesters. These Investigations should be undert^lcen 
before the results presented h^re should be regarded as conclusive evidence ; 



affect of required-enrollment. It Is also necessary to replicate this $tudy ^ 



4 
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Appendix A 



/ 



ERIC 




I atuj Ke»^a'ch Division, Ofricf In hI nivt >^»iil Kcsovjf^ts 



STIONNAI UK FORM 66 

KSITY OK ILLINOIS Vi Uy KIchnM K, Spcncor. 1965 




^5 



cr 
u 

^1 



n o ui ^ 



Ul »^ Uj 

m 

urn 



Ic.irn n o;c v/ h€n o t^ et te ac^ii'tg met hods .ire usgd > 



II was a waste of lime. 



The tex|t?cck vya s very ^ood. 



T'[ I e I f>^$t r lict 0 f seonie d t o be inte.e stcd in stude nts as persons. 

Mere couises should be taugM this w<Yy, . 

Tre ccj^sc^h cid my interest. ^ 



would hjyg prefetred ar>other method of tec-aching in this coufse. 



It was easy to rem.ain attentive. 



Ti I e '.n^.U u ct c ^ did^ i"" ot s yn thesj z i n tegtatc or sunmari zee (fec t vel y. 
Not ri'ch .VvU- by tjlsin^ this coLirs€, 



The instructof encQuragod Uie d o v e 1 o r^ii en t o f n ew v i e a po i n < s and ap preciat ions^ 
The course I'alerial seenied vyoithwhile. 



SAMPLE MARKS: 



USE 

PEKCfL 
ONLY \ 



o) 



RESPONSE 


CODE: 


MARK 


S A 


s 

If VO-J STPQKGLV ACffEE, 
WilH THE tJEM 


MARK 


A 


ir YOU ACRSe M0DERAT£IY 

wii« THL aeM 


MARK 


n 


If VOU UlSAGRet MODEfiATElY 
WITH THE ITEM . 


MARK 




IF VOU SfROSCLV DISAGREE 
AITK THE ITEM 



■ If W(is difficult to reinaiii attentive^ ^ ^ , 

Instr u c^or_ d ; l1 not r \, i e v; P ^ or ■ ip 1 1 and in siic h a__y*^ ay that de ri t s coujd underst and th c i r weakr.ess£>s , 
Hon ev^ Of k assign ^^•^jit s jve re^ e 1 p f 1 1 Ij^n^ mde \ st anding the c C' l j j^e 

The'irstfLictor ha d a th orough Xno^vlcdge of his sutjject maltef. 
Tiie conie;U of the course ' 



The course incfcased my general knoAiedge. 



The types of tost que stions use d s^■el^e gcod . 
Held ry i^tteiitior> throughout the c ourse 



The feiands of the students were not coj>sidereo by the- mstructof . 



Uf^interestin^ course. 



It was a very worthwhile course. 



Some things were not explained veiy well. 



* y'jy i nj^ hj^c hjh i o u r so waj taugh t Jesuits ^ n b etter student learnin g. 



The course material was too difficult. 



One of iny" c>oorest courses. 



Miitcnal in the course was easy to to! lew. 

Thj instructc ' seemed to consider teaching as a chore or routine activity. 



.jviore outside reading is necessary. 



Course niatetial was poorly organized. 



Course was not very helpfuU 



■ COMPLETE SECTIONS GELOW ACCORDING 
TO YOUR INSTRUCTOR'S DIRECTIONS: 



OPTIONAL 
PART II 
ITEMS 



5J-75 



OPTIONAL 
PART lit . 
ITEMS 76-100 



i f4 



It was quite interesting. 



1 think that the coutse was taught quite w'elL 



I wou:d prefer a different method oi inslfd^tioo. 



the pace'oj the course was too slo'^. 



At times I was confused. 



ExceJferH course content. 



■ i - ■ 



^Tlie examinations were too difficult. 



Generaity» th^ coL^ rse w^s welt Organized. 



mm- 



Ideas and concepts weie developed too rapidly. 



The content cf the course w^s too elerr.eniary. 



Sofre days as not very intereste d in this cou^s 



IC 



The inslTuctCE exhibited professional dignity and bearirig iji the classroom. 




.Anolhcr-mevhod of instruction" should have be,ef1 employed, 




The^^bufse was quite usefut. 


BLEASe FILL OUT THE OTHER SIDE 


^)^ould take another course thai was iatjght thi 



».r n/v icMi* M rii-i.^ OPTICAL I 



Official EvalucUion Form of THE ADVISOR Toacher - Course Kvojualion Guide 

Chiunpai^^n - Urban'* Ciimjjus Univer55ity of Illinois 

Pteasc»a$e this side ot Ihe form for your personal comments on teacher effectiveness and general course value--lhen turn It over and 
answer the objective questions on the' other side, u sing pencil only > f?eniember- these questipnnaires will be collected by a student 
in yDur class and mailed him to the Advisor staff. Your instfuctof will not see your completed evaluation, 

C OURSE CONTENT 

Please give your co:iirients en the ^:ursc co^itcnl, subject iriatter dnd any parlrcular relevance this course has had 16 yout area of stu4/. 

> 

" i 



INSJMCTQRl V/ftle int name of youf ■pnncirle Kisttt^or * T.A, 

Vihal are your iiCoeraS ccn^ncnts about the inslructof in this course' 



PAPERS AND H0I«EW6RK 



Cori:nent on the value of books, honiework, aad papers-i^f any) in this couise. ^ 



EXAMS 

Coaiment on lhe;exafns,(quizzes, practicals) as to difficulty, fairness, etc. 



GPERAL 

1 ' .What improvements m this course would you suggest? 



2v Please give your thoughtful evakiatlon of this course with comments. Are you satisfied with what you got out of this course? 
Do you consider it a valuable educationa.l experience^ Sinply a means of passing a requirement' OM^disappointnlenl? 
Please commcnl. ^ ^ ' ^ 



O " PLEASE FJLL OUT'THE OTHER SIDE. 

ERIC 



